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This comprehensive literature review identified 643 studies of professional development 
interventions related to math in grades K-12. Thirty-two of the studies used a research 
design for assessing the effectiveness of math professional development approaches, 
and five of those met What Works Clearinghouse evidence standards. Of the five, only 
two found positive effects on student math proficiency. 


This study used a systematic process modeled after the What Works Clearinghouse (WWC) study 
review process to answer the question: What does the causal research say are effective math professional 
development interventions for K-12 teachers aimed at improving student achievement? The study iden- 
tified and screened 910 research studies in a comprehensive literature search for effectiveness studies^ of 
math professional development approaches. (See appendix A for details of the search, screening, and 
review process.) 

Of these 910 studies, 643 examined professional development approaches related to math in grades K-12 
and were conducted in the United States. Of the 643 studies, 32 focused primarily on math professional 
development provided to teachers and used a research design for examining effectiveness (see appen- 
dix B for a list of the 32 studies). Five of those were determined to have met WWC evidence standards 
(version 2.1) either with or without reservations (appendix C).^ And of those five, only two found posi- 
tive effects on students’ math proficiency. 

Thus, there is very limited causal evidence to guide districts and schools in selecting a math professional 
development approach or to support developers’ claims about their approaches. The limited research on 
effectiveness means that schools and districts cannot use evidence of effectiveness alone to narrow their 
choice. Instead, they must use their hest judgment until more causal evidence becomes available. 
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The effects of five professional development approaches 
on student math proficiency 


Of the five math professional development approaches that had effectiveness studies that met WWC stam 
dards, two had statistically significant positive effects, one had limited effects, and two had no discernible 
effect (table l)d 


Table 1. Summary of findings for the five effectiveness studies of math professional development 
approaches that met What Works Clearinghouse evidence standards 

1 Findings of the effectiveness study 

Professionai deveiopment approach 1 

Statistically significant positive effects'* 

■ Intensive math content courses accompanied by follow-up workshops (Sample 
McMeeking, Orsi, & Cobb, 2012). 

• Lesson study focused on linear (measurement) model of fractions (Perry & Lewis, 
2011). 

Limited effects** 

■ Cognitively Guided Instruction (Carpenter, Fennema, Peterson, Chiang, & Loef, 
1989; Jacobs, Franke, Carpenter, Levi, & Battey, 2007).** 

No discernible effect** 

■ America’s Choice (Garet et al., 2010, 2011). 

• Pearson Achievement Solutions (Garet et al., 2010, 2011). 


a. Implies that the researchers are confident that there is a real, causal relationship between the professional development ap- 
proach and any subsequent changes in student performance and that the probability of observing such a result by chance is very 
slim. For more information, see U.S. Department of Education (2011) and WWC Glossary of Terms (http://ies.ed.gov/ncee/wwc/ 
Glossary.aspx). 

b. The effects were limited to knowledge of the equal sign. None of the measures of broader mathematics proficiency were significant. 

c. The findings described differ from those reported in Yoon, Duncan, Lee, Scarloss, & Shapley (2007), which evaluated studies 
of professional development from 1986 to 2006 using standards similar to but less rigorous than those of the WWC standards 
(personal communication with Kwang Suk Yoon). 

d. Implies that there was no evidence that the professional development approach had an effect on student math proficiency. For more 
information, see U.S. Department of Education (2011) and WWC Glossary of Terms (http://ies.ed.gov/ncee/wwc/Glossary.aspx). 

Source: Authors' literature review (see appendix A). 


Statistically significant positive effects on student math proficiency 

Intensive math content courses accompanied by follow-up workshops (Sample McMeeking, Orsi, & Cobb, 2012). 
This approach, stemming from a Mathematics Science Partnership grant funded by the National Science 
Foundation, combines math content courses and workshops. Teacher participants selected and enrolled in 
one or two university summer courses in math (lasting two to three weeks). The courses were geared toward 
the needs of middle school and upper elementary school teachers (for example, math modeling, algebraic 
patterns and functions, geometry). Each course focused 80 percent on math content, with time spent on 
math principles and math problems, and 20 percent on pedagogy. Fall follow-up workshops, held on four 
Saturdays, focused on designing lessons using the content from the summer courses. The fall courses were 
taught by university instructors, and the follow-up sessions were directed by both university instructors and 
district personnel approved by the university. This intensive professional development effort resulted in 
significant improvement in student math achievement as measured by the statewide assessment. The effect 
was found only for teachers who enrolled in two full math courses during the summer; there was no effect 
for teachers who enrolled in only one course. 

Lesson study focused on linear (measurement) model of fractions (Perry & Lewis, 2011). In the lesson study 
approach small groups of teachers observed and analyzed fractions lessons that they planned collabora- 
tively. The lesson study groups met 12-14 times over five months during the school year. Unlike the previ- 
ous approach, where university instructors or district personnel provided intensive training and follow-up. 
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teachers took turns leading the group, following the lesson study cycle outlined in the intervention mate- 
rials. Instructors and consultants provided the intervention materials (including a fractions toolkit that 
included materials to help students learn how to represent fractions on a number line'^) and were available 
to answer teachers’ questions as they led their teacher study groups. Implementation was thus similar to 
actual practice in a school or district. This study resulted in a significant increase of fractions knowledge on 
a test at the end of the year in grades 2, 3, and 5 but not in grade 4. 

Limited effects on student math proficiency 

Cognitively Guided Instruction (Carpenter et al., 1989; Jacobs et ai, 2007). Cognitively Guided Instruction 
focused on helping teachers understand how students think about math, what informal knowledge teachers 
bring to the classroom, and how algebraic principles can be linked to the arithmetic taught in elementary 
school. Carpenter et al. (1989) examined the effectiveness of Cognitively Guided Instruction provided in 
a founweek summer workshop. Jacobs et al. (2007) looked at an approach in which teachers met once a 
month, receiving onsite support from a facilitator one-half day a week. In both cases researchers from local 
universities conducted the professional development. Neither study provided the information needed to 
calculate effect sizes using WWC standards (version 2.1).^ Jacobs et al. (2007) found a statistically signih 
leant positive effect on student performance on a test focused on one specific, fairly limited topic: under- 
standing the equals sign for simple addition problems. 

No discernible effect on student math proficiency 

America’s Choice (Caret et al., 2010, 2011). America’s Choice asks teachers to solve sets of math problems 
both individually and in small groups, use precise definitions, give short oral presentations explaining how 
they solved the problems, and receive feedback on their approach. Teachers present their solutions and 
discuss the most common student misconceptions associated with the topic. This approach was adapted 
to conform to the requirements of a national research study on rational numbers for grade 7 students. The 
adaptations included retooling the scope and sequence of the professional development approach. On a 
test of student knowledge of rational numbers, no statistically significant effect was observed at the end of 
either year 1 or year 2. 

Pearson Achievement Solutions (Caret et al., 2010, 2011). Each professional development segment of Pearson 
Achievement Solutions (also referred to as Lesson Lab) focuses on a single problem or task. Each task 
is designed to elicit multiple approaches, which are intended to fuel extended discussions on the core 
ideas, common student approaches, and potential misconceptions associated with the task. The tasks 
were open-ended, and facilitators used their expertise to structure the discussions and determine whether 
to extend a professional development segment to address teacher responses. Extensive time was devoted 
to lesson planning, which was supplemented by videos. As in the America’s Choice study, this approach 
was adapted to conform to the requirements of a national research study on rational numbers for grade 7 
students. The adaptations included retooling the scope and sequence of the professional development 
approach. On a test of student knowledge of rational numbers, no statistically significant effect was observed 
at the end of either year 1 or year 2. 


Implications of the findings 


Until more causal evidence becomes available, schools and districts must supplement the limited evidence 
of effectiveness with their best judgment. Schools and districts should be encouraged to rigorously evaluate 
professional development approaches themselves and, when possible, to report the findings publicly to build 
up the knowledge base on the topic. 
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Appendix A. The search, screening, and review process 


The research question that guided the systematic review of evidence outlined below was: What does the 
causal research say are effective math professional development interventions for K-12 teachers aimed at 
improving student achievement? 

Study eligibility criteria 

To be included in this review, studies had to meet four relevancy criteria: 

• Topic. Each study included an intervention, program, or product focused on providing math profeS' 
sional development to teachers. The professional development had to focus on improving teacher 
content knowledge and instruction in math in order to improve student learning in math. 

• Time. Math professional development studies had to be published between January 2006 and July 
2012 or be identified in Yoon et al. (2007) as having met standards similar to earlier What Works 
Clearinghouse (WWC) evidence standards.^ 

• Sample. The sample had to include math teachers and their students in grades K-12 in the United 
States. 

• Study design. Only studies that used a randomized controlled trial or a quashexperimental design 
with a comparison group were included. 

Reviewing studies using What Works Clearinghouse evidence standards 

Studies were reviewed using the WWC Procedures and Standards Handbook (version 2.1) for group design 
studies (U.S. Department of Education, 2011) . Although each study that met the screening criteria was 
reviewed by a WWC'Certifled reviewer, this report is not a WWC review but was modeled after the WWC 
approach to reviewing causal evidence. Studies that the first reviewer determined to have met standards 
were reviewed independently by a second reviewer. A senior reviewer double'checked each completed 
review to ensure its accuracy and to reconcile any differences between the reviewers. The summary of pro- 
grams described in this report includes only professional development approaches with studies that review- 
ers determined met WWC evidence standards (version 2.1), with or without reservations. 

Screening the research studies 

Initially, 910 research studies were located through a comprehensive literature search (figure Al). Studies 
were then screened using a three-phase process: 

• 643 studies met Phase 1 screening, which means that they: 
o Included an intervention related to math. 

o Were published between January 2006 and July 2012 or were identified in Yoon et al. (2007) as 
having met standards similar to earlier WWC evidence standards, 
o Examined students in grades K-12. 
o Were conducted in the United States. 

• 47 studies met Phase 11 screening, which means that they: 

o Included an intervention, program, or product focused primarily on providing math profession- 
al development to teachers. 

o Used a relevant design (randomized controlled trial or quasi-experimental design). 

• 32 studies met Phase 111 screening, which means the nature of the math professional development 
approach was relevant to this brief (15 studies from Phase 11 were excluded because the profes- 
sional development approach was either generic professional development that did not focus on 
math — for example, school reform focused on strategic plans — or professional development that 
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was associated with implementing a specific curriculum.) These 32 studies were reviewed using 
WWC evidence standards (version 2.1). 

• 5 studies met WWC evidence standards (version 2.1), with or without reservations. One two-year 
study was discussed in two reports, each focused on one year of the project (Caret et al, 2010, 
2011). This was treated as one study, but two professional development approaches were involved. 
Impacts were reported separately for each approach. One professional development approach (Cog- 
nitively Guided Instruction) was included in two studies. 

• 2 studies (representing two professional development approaches) met WWC evidence stan- 
dards (version 2.1), with or without reservations, and showed positive impacts on student math 
proficiency. 


Figure Al. Screening funnei 



Source: Authors. 


5 


Appendix B. Thirty-two finai studies reviewed 
using What Works Ciearinghouse standards 


Of the 910 studies identified in the literature search, 643 examined interventions related to math in grades 
K-12 and were conducted in the United States. Of the 643 studies, the 32 studies listed in this appendix 
focused primarily on math professional development provided to teachers and used a research design for 
examining effectiveness. Five of those were determined to have met What Works Clearinghouse evidence 
standards (version 2.1) either with or without reservations; these are identified with an asterisk. 

Balfanz, R., Mac Iver, D., & Byrnes, V. (2006). The implementation and impact of evidence-based math- 
ematics reforms in high-poverty middle schools: A multfisite, multi-year study. Journal for Research in 
Mathematics Education, 37(1), 33-64. http://eric.ed.gov/?id=EJ765472 

Bell, C., Wilson, S., Higgins, T, & McCoach, D. (2010). Measuring the effects of professional development 
on teacher knowledge: The case of developing mathematical ideas. Journal for Research in Mathematics 
Education, 41(5), 479-512. http://eric.ed.gov/?id=EJ902109 

Blank, R., Smithson, J., Porter, A., Nunnaley, D., & Osthoff, E. (2006). Improving instruction through school- 
wide professional development: Effects of the data-on-enacted-curriculum model. ERS Spectrum, 24(2), 

9-23. http://eric.ed.gov/?id=EJ795681 

Boston, M., & Smith, M. (2009). Transforming secondary mathematics teaching: Increasing the cognitive 
demands of instructional tasks used in teachers’ classrooms. Journal for Research in Mathematics Educa^ 
tion, 40(2), 119-156. http://eric.ed.gov/?id=EJ833624 

Broyles, M. (2009). The effect of teacher participation in the Gateway Institute of Algebra on student academic 
achievement. (Doctoral dissertation. Union University, 2009). ProQuest UMI No. 3323764. 

Campbell, R, & Malkus, N. (2011). The impact of elementary mathematics coaches on student achieve- 
ment. Elementary School Journal, 111(3), 430-454. http://eric.ed.gov/?id=EJ963689 

*Carpenter, T, Eennema, E., Peterson, P, Chiang, C-P, & Loef, M. (1989). Using knowledge of children’s 
mathematics thinking in classroom teaching: An experimental study. American Educational Research 
Journal, 26(4), 499-531. http://eric.ed.gov/?id=ED292683 

Dominguez, P, Nicholls, C., & Storandt, B. (2006). Experimental methods and results in a study of PBS 
TeacherLine math courses. Syracuse, NY: Hezel Associates. http://eric.ed.gov/?id=ED510045 

Eigueroa, M. (2008). Examination of a new method to teach elementary students mathematics. (Doctoral 
dissertation. Northern Arizona University, 2008). ProQuest UMI No. 3318482. 

*t Caret, M., Wayne, A., Stancavage, E, Taylor, J., Eaton, M., Walters, K., et al. (2011). Middle school 
mathematics professional development impact study: Findings after the second year of implementation 
(NCEE 2011-4024). Washington, DC: U.S. Department of Education, Institute of Education Sciences, 
National Center for Education Evaluation and Regional Assistance. http://eric.ed.gov/?id=ED519923 

*t Caret, M., Wayne, A., Stancavage, E, Taylor, J., Walters, K., Song, M., et al. (2010). Middle school 

mathematics professional development impact study: Findings after the first year of implementation (NCEE 
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2010-4009). Washington, DC: U.S. Department of Education, Institute of Education Sciences, 
National Center for Education Evaluation and Regional Assistance. http://eric.ed.gov/?id=ED509306 

Harvey-Buschel, R (2009). A quantitative examination of factors that impact technology integration in urban 
public secondary mathematics classrooms. (Doctoral dissertation, Bowie State University, 2009). 
ProQuest UMl No. 3365812. http://eric.ed.gov/?id=ED512800 

Heller, J. 1., Curtis, D. A., Rabe-Hesketh, S., & Verboncoeur, C. (2007). The effects of “Math Pathways 
and Pitfalls” on students’ mathematics achievement: National Science Foundation final report. Wash- 
ington, DC: U.S. Department of Education, National Center for Education Statistics. http://eric. 
ed.gov/?id=ED498258 

*Jacobs, V., Eranke, M., Carpenter, T., Levi, L., & Battey, D. (2007). Professional development focused on 
children’s algebraic reasoning in elementary school. Journal for Research in Mathematics Education, 
38(3), 258-288. http://eric.ed.gov/?id=EJ765495 

Laumakis, R, & Herman, M. (2008). The effect of a calculator training workshop for high school teachers 
on their students’ performance on Elorida state-wide assessments. International Journal for Technology 
in Mathematics Education, 15(3), 87-93. http://eric.ed.gov/?id=EJ837650 

McBride Martin, A. (2008). The effects of professional development to create standardsTased curriculum on 
student achievement in fourth and fifth grade mathematics classrooms. (Doctoral dissertation, Indiana 
State University, 2008). ProQuest UMl No. 3299648. 

McIntosh, T. (2010). Math matters: A study of a professional development program for a group ofK—8 teachers 
in the Alum Rock School District. (Doctoral dissertation, Eielding Graduate University, 2010). ProQuest 
UMl No. 3371266. 

*Perry, R. R., & Lewis, C. C. (2011). Improving the mathematical content base of lesson study. Summary of 
results. Retrieved January 24, 2013, from http://www.lessonresearch.net/IESAbstractlO.pdf 

Phelan, ]., Choi, K., Niemi, D., Vendlinski, T, Baker, E., & Herman, J. (2012). The effects of 

POWERSOURCE® assessments on middlc'School students’ math performance. Assessment in Educa^ 
tion: Principles, Policy & Practice, 19(2), 211-230. http://eric.ed.gov/?id=EJ962954 

Phelan, ]., Choi, K., Vendlinski, T, Baker, E., & Herman, J. (2011). Differential improvement in student 
understanding of mathematical principles following formative assessment intervention. Journal of 
Educational Research, 104(5), 330-339. http://eric.ed.gov/?id=EJ934894 

Phelan, ]., Vendlinski, T, Choi, K., Dai, Y., Herman, ]., & Baker, E. L. (2011). The development and impact 
of POWERSOURCE®: Year 5 (CRESST Report No. 792). Los Angeles: University of California, Los 
Angeles, National Center for Research on Evaluation, Standards, and Student Testing. http://eric. 
ed.gov/?id=ED520532 

Ribeiro, J. (2009). How does a codearner delivery model in professional development affect teachers’ self- 
efficacy in teaching mathematics and specialized mathematics knowledge for teaching? (Doctoral dis- 
serration, Johnson & Wales University University, 2009). ProQuest UMl No. 3387318. http://eric. 
ed.gov/?id=ED528371 
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Ross, J., & Bruce, C. (2007). Professional development effects on teacher efficacy: Results of a randomized 
field trial. The Journal of Educational Research, 101(1), 50-60. http://eric.ed.gov/?id=EJ776274 

Sample McMeeking, L., Cobb, R. B., & Basile, C. (2010). Evaluating long-term complex professional 
development: Using a variation of the cohort control design. Evaluation & Research in Education, 

23(4), 273-285. http://eric.ed.gov/?id=EJ903678 

*Sample McMeeking, L., Orsi, R., & Cobb, R. B. (2012). Effects of a teacher professional development 
program on the mathematics achievement of middle school students. Journal for Research in Mathe- 
matics Education, 43(2), 159-181. http://eric.ed.gov/?id=EJ978876 

Santagata, R., Kersting, N., Givvin, K., & Stigler, J. (2011). Problem implementation as a lever for change: 
An experimental study of the effects of a professional development program on students’ mathematics 
learning. Journal of Research on Educational Effectiveness, 4(1), 1-24. http://eric.ed.gov/?id=EJ911538 

Saxe, G., Gearhart, M., & Nasir, N. (2001). Enhancing students’ understanding of mathematics: A study 
of three contrasting approaches to professional support. Journal of Mathematics Teacher Education, 

4(1), 55-79. http://eric.ed.gov/?id=EJ622169 

Smithson, J., & Blank, R. (2006). Indicators of quality of teacher professional development and instructional 
change using data from surveys of enacted curriculum: Findings from NSF MSP-RETA project. Washing- 
ton, DC: Council of Chief State School Officers. 

Stone, J., Alfeld, C., & Pearson, D. (2008). Rigor and relevance: Enhancing high school students’ math 
skills through career and technical education. American Educational Research Journal, 45(3), 767-795. 
http://eric.ed.gov/?id=EJ807311 

Stone, J., Alfeld, C., Pearson, D., Lewis, M., & Jensen, S. (2006). Building academic skills in context: Testing 
the value of enhanced math learning in CTE. Columbus, OH: National Dissemination Center for Career 
and Technical Education, Ohio State University. http://eric.ed.gov/?id=ED493604 

Topping, K., Miller, D., Murray, P, & Conlin, N. (2011). Implementation integrity in peer tutoring of 
mathematics. Educational Psychology, 31(5), 575-593. http://eric.ed.gov/?id=EJ932919 

Vendlinski, T. R, & Phelan, J. (2011). Using key conceptual ideas to improve teacher use of formative assess^ 
ment data (CRESST Report No. 794). Los Angeles: University of California, Los Angeles, National 
Center for Research on Evaluation, Standards, and Student Testing. http://eric.ed.gov/?id=ED520526 

Williams, L. (2010). Building connections between sociomathematical norms and cognitive demand to improve 
the quality of whole class mathematics conversations. (Doctoral dissertation. University of Wisconsin- 
Milwaukee, 2010). ProQuest UMl No. 3437973. http://eric.ed.gov/?id=ED523425 


t Garet et at (2010) and Garet et al. (2011) are together considered one study because the same two-year study appears in both 
reports. Each report focuses on one year of the project. However, because two different professionai deveiopment approaches 
were invoived in this study, the impacts for each approach are reported separateiy in this report. 
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Table Cl. Intensive math content courses accompanied by follow-up workshops: potentially positive effects (professional 
development approach more effective for teachers enrolled in two math courses than for those enrolled in just one) 


Appendix C. Research basis for the five studies 
meeting What Works Ciearinghouse evidence standards 
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Table C2. Lesson study focused on linear (measurement) model of fractions: potentially positive effects (one study with significant impact on 
student achievement) 


75 

(Q 

4^ 


o 

S 

lA 

‘iM 

.52 

(Q 

O 

O 



V 

n 

HM 

'c 

Q. 

(/) 

■{« 



00 


i o 

c/5 tU) Q) 
C "O > 

o 

5 

o 


2 - 


CD 
CO CO 


o o 
^ o 


o 

o 


CO O 
05 CO 


CO CO ^ 


0 CD CD 


0) o 


.2 £ 
CO -00 


(D £ 

<D CO 
C/5 C 
O O 
O ‘-M 

^ o cn -M c 

O CD ^ — 0) 


Jr! ^ CO 


2 5? 

<D 


z 5 o “ 


.. CD 
0) 05 


tcO ^ 
C '^t 

ro n 


2 ^ 

05 O 
CO tlO 05 
C "O > 
o 05 05 


CD 
05 
CO CO 




>, 




3 

CO 

c 

Di) 

05 





p 



p 

c 


C 

05 

05 

JZ 

o 

"cD 

o 

o 

CO 

'cl 

o 

•1— ■ 
o 

o 

5 

o 

2 

5 o 

O 

CO 

05 

CO 

O 

JZ 

tio 

c 

c 

o 

05 

o 

CD 

05 

CO 

(— 

•qO 

c 

M— 

JZ 

CD .£ 
■n 

’> 


>, CD ^ 

E >2? g 


•QO 

2 ^ 
^ w 05 

O CD — — 


_ O 
CD ’(/} 

CO 0) 


CD .2 CO CO 


0 05 

5 o 


CO ^ 

.<u ^ 


05 


05 


05 ^ 

05 CO 
^ 5a0 
CD c — 


I 05 
CM > 
9. ^ O 


CD 05 
3 g 
■D E 


o 

5 


■O 

o 


05 

■o 

CD 


CO 

cm" 


2 


® i2 o 

0 -a m CO 

E 


CD CO 
05 


CO 


I ^ 05 i 

<V) ^ -O -O 

1 H P- 2 t- 

5a0 CM 


CN 


O 

LO 

CN 

CD 


05 

rsj "D 

E E 
o o 


E ^ 


05 -Q 


05 

n 

CD 


o 

c3 ^ 
of CD 
of CD 

O 0 
Q_ —I 


CM 


s S 

^ I 

I I 
I I 


S CD p. ^ 


O 

tH 


o E 
b "g 2 

CD > ^ 

E .2 co 

5 E -H 

3 d> O 
CO cc CM 


< 

CO 

LU 


CD O 


05 

■u 

O 

CD 


05 

£ 

3 

O 

o 

■O 


10 


reviewed journal in the near future. 
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Note: Student-level effect sizes were not calculated because the authors reported only classroom-level data and were not able to provide additional data when requested. 

a. Authors reported results as nonsignificant but did not report effect sizes or relevant data for calculating effect sizes at the level of assignment (school level) using What Works Clearing- 
house standards (version 2.1). However, because the authors used liberal means of calculating statistical significance, none of the effects would be statistically significant using the school as 
the unit of analysis. 

Source: Authors’ literature review (see appendix A). 
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Notes 


1. Effectiveness studies determine whether there is a causal relationship between the approach and the 
outcomes; in this case, effectiveness studies examine whether mathematics professional development 
approaches cause improvements in student mathematics proficiency. 

2. These studies focused only on students in grades 1-8. 

3. There are many professional development programs and approaches beyond the five presented here, and 
not all five have positive findings. These five are highlighted because the research evidence for these 
approaches is of the highest quality in terms of determining the professional development approach’s 
effect. For this WWC-style review, the review team determined that these five studies met WWC 
evidence standards (version 2.1) with or without reservations. Effect on student achievement is just one 
piece of evidence to consider when deciding whether to adopt an approach. 

4. Earlier case study research suggests that focusing on concrete materials that are also used in the class- 
room is a hallmark of effective professional development (Caret, Porter, Desimone, Birman, & Yoon, 
2001; Gersten, Chard, & Baker, 2000; Huberman & Miles, 1984). 

5. This finding differs from those reported in Yoon et al. (2007), which evaluated studies of professional 
development from 1986 to 2006 using standards similar to but less extensive in some dimensions of 
research quality than an earlier version of the WWC standards (personal communication with Kwang 
Suk Yoon). 

6. Yoon et al. (2007) evaluated studies of professional development from 1986 to 2006, using standards 
similar to, but less extensive in some dimensions of research quality than, an earlier version of the 
WWC standards (personal communication with Kwang Suk Yoon). 
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